Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling.

نویسندگان

  • A David Redish
  • Steve Jensen
  • Adam Johnson
  • Zeb Kurth-Nelson
چکیده

Because learned associations are quickly renewed following extinction, the extinction process must include processes other than unlearning. However, reinforcement learning models, such as the temporal difference reinforcement learning (TDRL) model, treat extinction as an unlearning of associated value and are thus unable to capture renewal. TDRL models are based on the hypothesis that dopamine carries a reward prediction error signal; these models predict reward by driving that reward error to zero. The authors construct a TDRL model that can accommodate extinction and renewal through two simple processes: (a) a TDRL process that learns the value of situation-action pairs and (b) a situation recognition process that categorizes the observed cues into situations. This model has implications for dysfunctional states, including relapse after addiction and problem gambling.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The effect of high-fat diet on extinction and renewal.

Diets high in saturated fats are linked to health problems and impairments in cognitive function in humans. Recent evidence suggests that exposure to a high-fat diet can impair rats' ability to appropriately inhibit responding to stimuli that are reinforced in some circumstances but not in others. Here, we examined the effects of exposure to a high-fat diet on the context-specific renewal of ex...

متن کامل

Stress before extinction learning enhances and generalizes extinction memory in a predictive learning task.

In extinction learning, the individual learns that a previously acquired association (e.g. between a threat and its predictor) is no longer valid. This learning is the principle underlying many cognitive-behavioral psychotherapeutic treatments, e.g. 'exposure therapy'. However, extinction is often highly-context dependent, leading to renewal (relapse of extinguished conditioned response followi...

متن کامل

Why are Some Games More Addictive than Others: The Effects of Timing and Payoff on Perseverance in a Slot Machine Game

Manipulating different behavioral characteristics of gambling games can potentially affect the extent to which individuals persevere at gambling, and their transition to problematic behaviors. This has potential impact for mobile gambling technologies and responsible gambling interventions. Two laboratory models pertinent to this are the partial reinforcement extinction effect (PREE) and the tr...

متن کامل

Extinction Learning as a Model of Drug Treatment and Relapse: A Behavioral Overview

Extinction is the process by which a previously established stimulus relationship is broken by the removal of reinforcers and/or biologically relevant stimuli, causing a reduction in responding. Given the importance of this phenomenon in terms of understanding not only learning and behavior, but also of enhancing our understanding of drug addiction and treatment, there is renewed attention bein...

متن کامل

Renewal after the punishment of free operant behavior.

Three experiments examined the role of context in punishment learning. In Experiment 1, rats were trained to lever press for food in Context A and then punished for responding in Context B (by presenting response-contingent footshock). Punishment led to complete suppression of the response. However, when responding was tested (in extinction) in Contexts A and B, a strong renewal of responding o...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Psychological review

دوره 114 3  شماره 

صفحات  -

تاریخ انتشار 2007